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ABSiIrAGT* .V 

Race and' sub ject-matter 'inf J,uences -on performance on 

the National Teacher Examinations (NTE) were assessed in a study of 
the effects of changes in con'tsyit of so-called general, education' , 
items designed to reflect contributions of black and '"nlbdern** 
subcultures. The test used in the study was a 65-item si^test of the 
NTE designed to measure candidates' knowledge of s ub ject-*matter 
content in the areas of social studies, literature,, and fine arts, 
sometimes Called 'the ‘"general education subtest^. Original and 
replication studies were made and showec^ consistently the impact on 
relative ' performances of black and. white candidates ttet, relajte to 
decisions about relative numbers .of black, modern,' and traditional 
items included in the NTR. The results leSve little doubt the t- black 
.candidates tend . to possess a different set of knowledge .than'^ white . 

candi dates, <and that these differences'/ have little to do with 
"cohventional subject-matter areas. (Lri) « • • 
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RACE AND SUBJECT-MATTER INFLUENCES ON PERFORMANCE ON 
GENERAL EDUCATION ITEMS OF THE NATIONAL TEACHER EXAMINATIONS^ 



\ 



The primary purpose of this study was to assess race and subject-matter . 

• ^ 

influences on performance on the National Teacher Examinations. Specifically* 

t ^ *• - . # 

the* effects ©f changes in content of so-called general eduqation items designed 
to reflect contributions of black and "modern" subcultures were investigated • 
The test used in the study x^s a 65-item subtest of the National Teacher 

■ ’V . V. • 

Examinations (NT^) 'designed to measure candidates * knowledge of subject-matter. . 
• content in the areas of social studies, literature, and fine arts, sometimes 
/.palled the general education s 4 ibtest . v . 



Rationale 
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The basic question asked was. whether, apd to wliat extent, projected 
changes in,the tfest would alter the relative standings^ of cilndidates in the 3 
.population that takes the examination. ,If changes in item content do produce 
systematic changes in rank order, then the validity of the test (for any ^ 

. s 

» * 

purpose.) may be affected , . since the type of candidate who does best on the 

examination will change. ' . 

Hyf)otheses about what type of candidate is likely to/perform'differently 
• \ . 
oh some^new kind of- item may be tested by studying how^thte mean refative 

scores of groups^of candidates are affected by changes in item content. 

• * ' ' ‘ ' / 

Subtest scores on the Social Studies, * Literature and Fine Arts section of the 

NTE have ne(yer been/eqtiated from form to form; thu^ it is not possible Vo 

generalize correlations between this subtest and "teacher' effectiveness," 

* evdn if a reasonable criterion of teacher effectiveness could be presented. 

*. • •*' 

Given these two factors it is not possible to evaluate systematicaliy the 
poss'ible bias of the test within a predictive framework. The differences 
between the performance of known subgroups qf candidates on items of differentr 
types, therefore, become important in their ox^ right. * ^ " h 
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I , . . , 

Description of the’ Exper^ental Forms . ^ \ ' 

^ Two experimental forms of . the NTE Common Examinations were prepared 
(Forms A and B). Form A wad administered during one of the regular adminis- 
trations of the NTE in 1970 and. again dufing one of the regular NTE admihis- 
' tratiofis ial971, while Form B was used during that same regular administration, 

of th4 NTE in 1971. The second form was* used to study whether the effects 

* . • ■ 
-defected in 1970 could be replicated with different items as we'lT as witH 

different groups of candidates. The Social Studies, Literature, and Fine! Arts 

, section of each form was modified to include a larger proportion of itemsVthan 

the regular form in terms ^’of items relatei^to-^cbntemporary culture ("modern** 

items) and of items related to cultural contrib\it ions of black authors and 

artists (**black** items) , and a smaller proportion of items than the regular 

*/ ' ' " ' * , • 
form in terms of items related ter classical and .traditional culture (**tradi£ional** 

f "Items) . * - . ' 



Insert .Table 1 about here 



V- 



■ / 

" In each of the^'two experimental forms, enough experimental items were 

% 

• ^ 
substituted for traditional items within their corresponding subtests on 

the regular form^of the examipation to achieve the*distribution of item 

types shown in Table 1. Neither the experimental items nor the items which 

they replaced were* used in determining a' candidate’s NTE. score, so that the 

NTE scores of a candidate would be b^sed on the same items regardl&s of 

» / i * ^ 

' ' . " ■ * ^ 

whether he^toofc the regular form or'one of the two experimental f^ms of 
the* test. " ; " 
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The black and modern items written for the experimental forms were not 
designed Co sample, knowledge peculiar to any particular group. Rather, 
they were intended, to recognize the contribution to American culture of 
people who. happened to be black (in t^^ case of black items) or of people 
who happened to live in- the iast few decides ^(in' the cAse of modern items) • 

Items classified as Mack items dealt with aspects of the experience and 

► • ..V • ‘ ' . ‘ • 

culture “^contributed by black authors, artists, writers, musicians, and - 

important, historical and political black figures*. Items classified as modern 
item^ dealt, with aspectp of contemporary culture an4 contemporary affairs -such 

, j * , . " , < . * • 

as recent developments in music, art, literature, social philosophy, social 

^ r#'. 

change, and politics that* are not oriented toward the black culture. ‘' Items 
classified as. traditional items dealt with such topics aS world trade, . 

geographical aspects of countries, chronological development o-f various 

historical , events, differences between political systems, artifacts of various 

■' ' ■■ V ‘ ' ' ■ ■ / - ■ ' '* 

cultures, authors and aspects of woifld literature, music, ana dance but. 

' . * * • 
which did not* emphasize aspects of either black or modern culture.. The 

definitions of these categories were purposely kept rather general in order 

. * ■ * ■ .. . I . ■ ^ 

to provide a conservatdve test of the hypothesis concerning the differences 

between different types of items. It was intended that, like the traditional 

✓ 

items, these items would s^ample knowledge that any well-informed candidate 
should possess. Every 'item ;ur>derwet\t the usual, procedures o^ construction 






and review aitld met the stapjj^rdg of quality customar ily* maintained for^TE 
items. . ; - \ * 
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PROCEDURE 



• 



It is convenient tp think of the study as made up of two separate . • 

experiments. The original study used Form A and was cotidugteJ in 1970; 

. / ■ I ■ . : . 

the replication s-tudy used both Forms A and B and was-conducted one' year 

lat^r,, in 1971, and constituted, in effect a replication bf the first study ^ 

using new cafididates and items. : ’ 

c- ' , • - * • • 

* \ # 

• ■ ■ • - ^ _ j 

The Sample of Candidates for this Original Study . . 

* ’ ■ ^ • 

For the original study, a l^t bf th,e tenters in which the NTE was to be" 
administered on the regular testing date was obtained, together with the record 
of the number pf candida:tes tested in each of these c'enters»one y^ar earlier. 

Centers -were classified as urban if they were lo.cated in cities of 10Q,000 or . 
more^ or as rural if they were located in cities of less than 100,000 (Longi 1968). • 
Each center was. further classified as predominantly black or not accord.ing to 

.f' ■ .. ■' . 

McGrath (1965).' The distribution- of the four blocks of available centers is 

" ■■ • fO ’ ■ 

given, in Table 2. . s 



•> . 



Insert Table 2 about here 
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• The centers within each of these four 'blocks, were then arranged sequentially 

by their center code numbers, the blocks were arranged in a pre-^Betermined 

sequence, and then a cumulative frequency range’ of candidates across blocks was 

/ •• • ■ 

computed based on the number of candidates .who took the NTE at that center a 
. year earlier^ * ^ • / 

■■ V . ■ ' ^ ■■ - • 






I ** * 



V* • 
\' i • 



ii 

ERIC 



• •/'» 

f 



6 • 









-5-' 






. f 



i 



O 

RiC 



A ^total of 36,A26 candidates had. taken the NTE in these centers* one year. 

V . • , » . ; ' 4 . , 

earlier* The .original research plan called for .sampling ^approximately 2, *800* 

candidates implying ‘that approximately 13 'c.edt:ers Should 'te sampled if the 

candidates were equally ^di^ributed across testing, centers. The first random 

V , , \ "■ ■ ■ 

nlimber selected was requiije^ toi* be less than the total number' of candidates- 
tested in the first b.lock, the black— rural blo*ck, in order, tb insure that at* 
least qne black-rural center would be selected, dnce 'this first random 

numbfer was chosen, the number 2,802 (36,426 f 13 = 2,802) was added to that 

. ^ ^ / * . . 

first number 12 ^separate times as a ^orm of cluster sampling, and fhe ij test 

. ■ r ■ '* - . 

centers which contained a cumulative frequency matched by this resulting 
number set wi?re selected to be included in the study. If a center vas selected 






V . i • ’.V • # ’ ^ . 

which -had fewer than 50 candidates taking the test- one year earlier, then both 

• ■ i. ■ / 

that center and the center adjacent .to it within the^ block^which contained' tlje 



S 



smaller numbet of c'^jraidates of the two adjacent centers were selected. This ’ 

. V ^ ^ * ■ / V ^ ^ i** 

increased the number of .selected centers from 13 to 16. . * 

• ■» . •» 

- ^ * / » * . * , ' . * 

• # In order to reduce the logistical problems iYivolved in using 16' center si’ . • 

. , V t: 

the list of lj6 centers was reduced to eight centers. Of the originai*16 

centers, the one black— rural center and the two black-urban centers were retained ; 

the three white-urban centers were Reduced to two: and -the^ 10 whiCe-.rural 

, . !/ 

centers were reduced tQ^ three. One white-urban center found it impossible to 

•** ** * *v***».l 

cooperate on the collectidn of racial data, one white-urban center tested* only 



I 

25 college senators, and one white.-rrural center was .mailed the wrong test form. 

' ■ ’ ■ " '.X • ' 

thus reducing'lhe number of test centers to five. The final list or^select'ed 
centers is shown in Table 3 pogether with the number of senioi^s of each type 
in each center.. ' In Table 3, ^population inf the first cblumr/'ref er s to the size 

j 
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.of the population in th6 cit^ in whic*h t,he KTE testing cen^;er w^s loca.ted, as 



/ 



• \.- 



■ given in Long (1968) . 









Insert Table Sf^about heire 



* . - • > - • "I ‘ * 

*' In each of the remaining five centers, one or^more groups of 44 college, 
senior's of the same, race and sex were.'dravm at random; the seven groups obtained 



constd 



tute^tlie 'sample of tandidates s tudied , -aifd these are designated' in Table 3.' 
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The Sample of Candidates > for the Rep^l-ication Study ." ,, • . 

..... ' r“ ■ • . • . ' 

. 'In order to examine more closely^ the* pattern of test reSul^ts found in 

I ' N ■' • - ' ' 

Fprm-^ of the JJTE Common Examiaiations,'^two additional stu^/les '-were carried 

■ * ' . ■ . ■ . . '■ " 
out. The first study involved repeating the identical, critical test 'items 

• ' ft 

ilsed in Form A while the second study involved a different set of items in ' 

] • i ' • ■ . . r 

' . ‘ ' / ' , 

Form 8; the data for both a,dditional studie^were collected at the Same tirfe • 

•i ' ■’ * ' ' '*' • 

one. year after the'original data for Form A wgre collected. : ' • .. 

' The test items, for' Form B met the same specif i'catiohs and review 
criteria as those of For;n A, and the exact satne -number of items of each. , 

* ' i ' 

ty^e occurred in Form B as had occurred' in Form A .(Table 1) ;• Form.B had 

. , • _ « 

10 items in the Tpad^tional-Literatune' subtest; a'nd five of these items 

. ; ' ' * • ' ’ * • . • • ’ 

were ' randomly sgle’cted -to be use’d i.n the replicati.on study.' 

' ' • . . • 

■ * I '■ . . •• 

The centers 'for' the replication 'studies were selected in the following 
mannef. All of the centets with .at le'ast 300 registered candidates one yea.r . 
earlier than.tjie scheduled replication testing date were grduped into a sfet;- 
t-here were~four centers in this- set, all io Texas', .and two c.enters were randomly 

. . - ' • ■ ■ ’ I ■ ■ 

, • / • 

cfibsen. Forms A and B were .mixed together iri these two centers in order to 
permit a comparison' of. th6 two forms of the. test for candidatfes within the 

* / ~ * 4T* i* 

same' testing c^enter.«* :• * v * 
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Next, the states of the United States' were grouped into five regions defin 
byJ[;o.leman et al. (1966, p. 39,). All centers with at least 140 registered* 
candidates one year earlier were grodped into the Northeastern and Midwestern 
regions; the eight such Northeastern centers \ 9 ere paired so that centers in 

... \ • r . ' . 

cities with approximately the .same population size (Long, 1968) and in close' / 

geographical distance were matched. From the Northeastern, pairs, one iriatched 
• * - ‘ . ^ 

paUr w^s selected without replacement and this pair happened to include two 

■ i •. ■ ’ ' " ' 

centers in the same city in New York State;' Form A was Randomly assigned to 
one of these centers while Form B was assigned to the other center. A baqkt^p 

• . •* ' I ^ * 

% 

center in a large city ir Pennsylvania was arbitrarily selected to provide* an 
- ■ ' 
additional replication center, and Form A was assigned to this center. 

* The four Midwestern centers were' located such thatf three of the centers' 

were in the same city in Illinois and Jthe one other center was located in a 

different state and in a qity in which the population was five times less than 

the city in which the other three centers were located, and therefore two 

centers were randomly, selected without ^replacement from the three centers that 

were’in the same city, with one- of these centers randomly assigned to Form A 

♦ I n 

m* * * ^ ' ' 

and. the other center as's.lgned to Foirm B. • ■ 

■ •* * 

Next, the/ black-urban ahd white-urban centers which had at least 140* 
registered qandidates onfe year earlier were grouped- intousets. Each black- ^ 
urban center was paired with a white-urban center so that the pairs were as 
close in geographical distance and population 'size as possible. t)ne black- 
.urban center was randomly paired with one. of the two white-urban centers which 

were^ located in the same ci±y, two additional njatched pairs were formed which 

^ ^ ^ ^ ' I 

had centers in the samercity^ and the last matched pair waS' formed by pairing' 

■ . ■ ' r 

the remaining black-urban center *with the closest centdr in geographical 
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diatance^'and^population size of 



" ^ -?- . . -■ ./ ' ■ : :. 

. • 't 

^ H N 

the three remaining white-urban centers. 



Of these four matched-pairs, two were* randomly selected , and one of othese 

: ■ • ■ 'v'; ; • ’ \ •• . • ; ■ ■ , 

pairs was randomly .as&igmed to I’ortn A while the otlier phi% was assigned to 

5 .. • - . ^ , ' ■ 

' Form B; as iti turned out, both dentets in each of EK§se pairs were located 
in the same city .' / . . , , 

Next, the -two black-rural jcenters with. .at I'east 140 registered /candidates 



one year eatlier were eaqh pai 



T 



ed with a wjiite-rurai center <of comparable 

I ’ . " ' " ' ■ • 

population in the same state.* j One pair was' randomly' assigned to Form A while 
'the other pair was assigned to Form B. . Unfortunately, the white— rural center 
assigned to Form A -had merged) With another college since McGrath's (1965) 



classification, and all of the 



Candidates tested in that center were black 

1 * I » • * 



instead o^ white, so the planned black-rural vs. . whitelrural comparison could 



i f 



not be completed for F<^rm A; instead, the black-rural center in Mississippi 

■- ’ \ ' 

was compared to\the white-rura 

■» . ■ . i 

geb^raphical region. In addle 

. .1 / '■ 

compared to the center in Miss 



bladk-rural center instead of 



y' 



\'l ' 1 - ' ^ i 

iJcenter in Maryland , thus confounding 

ion, that white-rural center ih Maryland was ^ 

I X ■ \ : 

ilsippi,. that, in fa.ct , turned out to be a 

] ^ ‘ • ✓ .! 

a ii white-rural center. ' 

I ■ . ' ■ . ' • : • ’ 

.—Finally, the white-ryral centers in the Northeast which h^ at least 

* ^ • n ^ 

^ . S' 

140 registered ^ndidates oh? year 'earlier were grouped into a set. Four 

centers r^ulted, of . yhich )one Vras arbitrarily deleted since it was surrounded 

' . 9 

•by a dense population; an additional center' was arbitrarily set aside as a 

back-up center because its population wasi considerably, larger than the two 

■ . I \ I ^ • 

remaining centers. Of the* two remaining centers, one was randomly assigned 

; \ • / - 

to For, TV A while the other was assigned to Form B. Unfortunately, .thfe centdr 

■ ' ■ . ' ■ \ ■ ' ■■■■■ 

assigned* to' Forift B could, not coc|pefate in data collection, and the placement 

' I ' V ■ ' ■ 

>llection, did not have a sufficiently large 



cent6r,jv while used irf the data co 

.n ■ , 



I' 
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sample of' college seniors to be 



^ : 






ujsed in the analysis. 



/ ■ fi- 



le \ 
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• * • ’ 

As it turne4 ou t , ‘none of the centers ^elected to participate in the ^ 

replication studies had been used in the original study one year earlier* 



The/number of college s&rfiors "tested in the replication studies, by subgroup, 
appear in T^le .4 and' Table In Tableii 4 .and 5, population, in- the first 
• 'polv-mn refers to the- s'ize of the population in the city in which- the NTE testing 
center .was located , as given in Lqng (1968) . \ * 

Insert TabJ.es \ and^5 abdut here • ' 
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In eaqh of t>he centers which iparticipated in the original study, as well 

' ' */ * ’ f ' 

as the centers which participated in the- replication ^study, an observed 
unbbtrusJLvely co*ded the candidate’s race as -blaclf, white, or other. . 

data analysis PROCEDUEIES ‘ , . . 

■ ■ • ^ ■' t:; ' . ; " - . ' - 

^^he* basic data analysis procedure used" in these three studies -was an 
analysis of variance design in which two factors were considered fixed ^ 
(Groups and Vorms) and two factors were considered random (.(Candidates and 

.’w , “V 

Items) such that each random factor nestfed within v^ne Of the fixe^d factors. 

as the • 



/ 



The jiumber of items answered correctly within eacj» sObtest .was taken 

* > ’ \ 
basic score unit. i ' * » • • 

All artalyses J>egan with the same design, which was basically a candidates 
* * . ■ • 

■ by it4s .aiv^ysis of variance (cf. Hc>.yt, 1941). The be^ween-candidates 
r variance was partitioned into two portions, one of which compared per forraarrces 
. of candidatds in dif ferent groups while Che other was based- on di.fferences 
between candidates within the same homogeneous group. ... 



) • ' 



/ 



I 






- 10 ^ 

' The variance between "Items was also .partitioned such that one por^iQli_^^^ 

"with eight degrees of freedom contrasted items from different subtests^mong 
the tune- subtests shown in Table !• while the other compared Htems w^ithin the 

^ • t* . « , • 

5* *• , f . 

same sub test... Between-subtest comparisons were further partitioned into the 
eight contrasts given in Table 6. The contrasts were orthogonal to each 
Other'* in the .sepse that they were based on independent bits of information. 
Ehcii contr«ast represents a hypothesis about differences in subject matter 
content, of items, the culture they represent, or both Interacting with each ^ 

<• ' P ' ' 

ot.ner. \ * 



V 



Insert Table "6 about here 



/ s ' / ■ 

Table 7 shows the basic design of the analysis without the partitioning 

V , ^ - 

of the eight degrees of freedom just described, assuming; that groups and 

■forms are "fixed effects" and that candidates within groups and items within 

■ « 2 * 

fonr.s are random ones, e^he two parameters of primary interest are and.^ 

I ^ 

P . , anci^thc two hypotheses o,f concern are: 

CF 

■ ”r 



”2' -^'CF ° 



Rejection of ilj^ inplie.s that the difference between group’ nedns differs on 
different forms of the test. Rejection of H 2 means that candidafe^ within 
the same group rank in different orders bn different forms of the test. - 



Insert Table 7 about here 
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lt is apparent that if H 2 were true, the mean squares obtained in 
lines/7 and 8 of Table 7 should differ only by chance, since their expected, 

* IK , ,, 

would be the same. The _F ratio comparing these two mean squares may 

r * ^ 

ier*efore be used to test the hypothesis. - 

A test of is not so easily derivjed. If is* accepted, the mean. 

squares in lines ,5 and' 6 o*f Table 7 will have the same expected value and 

. * • ■ * ■ , ■ • ^ 
r. * ■ I ' ■ 2 

can be used to test - If H 2 is rejected, the hypothesis that 0^^ = 0 * 
may be tested by comparing the mean squares in lines 6 and 8 of* Table 7. If 
^this hypothesis is accepted, may be tested by comparing the mean squares 
in Tines 5 and 7; otherwise, assuming H 2 to be false, and approximate 
procedure (Winer', 1962, pp. 201-202) is available. * ' ' . 

If the effect of 'forms is regarded as fixed then each of the eight'^ean 
squares of the between forms comparison has an expected value of the 5orm 

■ ■ C" ' ■ • i ' • '2 ■ • ' ■ • 

shown in Table* 7 for line 3 except, that the parameter 6^ v^ill have a different 
value. The same thing is true for the Groups -X Forms interaction and for the 
Candidates X Forms xijLtf^qction . Rejection of in any -given instance implies 
that group means differ m^re on,item^ of one of the two types contrasted in 
that line,’ and results in the Can(^idates^ )(- torirts interaction are similarly 
interpretable in terms of item types. In other words, both H- and II„ were 

. / ' 1 dL 

tested separately, with regard to eight alternative^ to the null hypothesis. • 

■ , ' Before a final decision was made with regard to any of these hypotheses, 

however, yie analysis was’ simplified . In every instance in which an 

hypothesis about any parameter was testable, the test was made, and if the* 

null hypothesis was acceptable with an F smaller than 2.00 (to minimize 

. * » 

the risk’ of accepting f alse'hypotheses) ,• the corresponding sum of squares 
were pooled with their respective error mean squares (Green 6 Tukey, I960). 
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Since results of these last two types, relevant to or,H 2 , are the ones 
of primary concern, they are the Only ones that are examined in detail within 
this article, " 



RESULTS 






The Original Study ' ^ * 

/ ■ ■ \ . 

The strategy adopted in analyzing the data for the original study was 

j ' 0 r 

to conduct^four separate analyses,' each using one pair of groups chosen to 

differ on a variable hy^thesized to relate to test performance, three •' 

pairs, of groups which -differed in race were compared in the original study:, 

B and E, A and G, and C and .D. Unfortunately, the racial .variable was 

confounded in each instance with some other variable. Contrasts between 

B and E, and also C and’D, both used black candidat.es tested in an urban 
^ • 

location (140,000) and whi^e candidates tested in. a 'rural one (10,000) in 

Mississippi, so that urban^ural factors could distort the results. ’ Groups A 

and G compared black women in Louisiana with white women in West Virginia,- 

/ 

and here also the black candidates were examined in a larger city than the * 

^ ‘ / r 

whites. In this- latter instance either a geographical or an urban- "semi-urban" 
influence could distort the results. Groups C and F (Table 3) were compared 
because they differed with respect to size of the community in which they - 
were tested, but did not differ in race or sex^ so that urban-rural differ- 

. s 



ences (if, a^) might be detected. 
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• The relevant findings from all four analyses of variance are presented 

in Table P and summarized in Table 9. The interaction between c'andidates and 

^ > "* 

■ / ' ♦ * • 
item types is of interest because it may be interpreted as indicating that* 

candidates vrithin the same group are ranked in different orders by items of the ' ‘ • 

two types; that, is, that the individuals who score the^highest an one type of • 
ite'm are not the same ones as score highest .on the ather type. In short, a %- * 

• , test made up entirely of one type of item would measure a different function • 

• * V " ' • ^ t 


/ 


«s * 

than one' made up entirely of items of the other type: • . " 

V. • . 

Insert Tables 8 and 9 about^here . * ^ 




Notice, for example, that in the comparison of Groups A and G,- candidates - • 

r* ■ • 

interact significantly widh social studies items vs. literature and art items 
(Table 9, line 6), implying that a particular candidate would not do equally 
n^ell on both a social studies and a literature-art test. This is not ' . ‘ . 


* « 


V * ‘ > *' • * ; 

surprising, since such tests would sample knowledge in* two quite distinct . 

‘ 1 


« 

< 

1 

, V 


fields of knowledge. Rather, it seems odd that in Jthe other two pair.s 6^ | 

different racial groups this* wa\ not the case. ThisMnay betaken as ° 

, ' indicating that the correlation, between two tests like these wbul^ be/- * 

substantial enough so that any differences in.wh^ they measure V70uld be - • / 

difficult to detect when only 30 items of each type ai^e used. \; • * . ' / 

Differences in the dimensions measured *by literature-art i1:ems are " 

even more difficult to detect (Table 9, line 5). In none of the four pairs r . 

• . ■ • ■ ■ ^ ^ 'J 

of groups was any evidence found that art knowledge was any diff^i;-ent from * ** * 

/-'* ■ . ■ , \ ' 

literary knowledge. It should te noted that only 15 items of each type were 

' ■ . ' - . • ^ j. • 

used, however. , ' • . . 

' " . ■ - ■ . • ' ^ :l ■ 

V _ . • • , . , ■ _ ■ ■ ' / 1 ' 
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Diffcreuces between a’ test made up of traditional' items' and one made 
up of equal numbers of black and modern items' (Table 9, line 4) were also 
difficult to* distinguish., (Since the statistical test here is based on 
comparing intraclass correlations between the two tests with the intreclass, 
correlations within them, it is likely that a rather low intercorrelation . 
between black and modern items has a lot 'to do with this.) \ 

In conttast,' significant interactions between; candidates and black. vs. 
modern -items were found' in three of the four analyses (Table 9, line 3). 

This suggests that culture rejiresented is probably a more important fkctor 
i^i,a candidate's performance when he is compared with others of his own 
race, sex, and institutional affiliation than is subject-matter content.' 

Data on individual candida'tes are not available to indicate how black 

• * '■ . . ■ 

candidates who knoy more about black or modern culture than about traditional 

culture, diffkr from black -candidates of the same-spx (tested in t'he same center) 

/ 

who knoto? less ' abou t black or modern culture than they do about traditional / 
culture. *■ » • 

Of most interest are interactions between gjroups.and it^em types because 
they indicate group differences in mean performance,-on the different types 
of items. No grout) differences related to subject-matter content Were 
• found which suggest-^ that the, racial groups differ by about ^le same -amount 

' ’ _ . ■'W * • 

on the. different subject .matter areas. ' 'Differences 'be.tween ‘•black and modern 

*“ ... C*'* 

i'tems, -on .the .other hand,' were found in a three racial. .comparisons, piffer- 

ences- between black and modern .items .combined . and traditional items were 

. • • ' ■ 

-• also found in all\bree-^racial contrasts^ as well as in the one between 
black women in urban Mississippi and- in rural Virginia. 
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. To facilitate cori»parisou of results Obtr.ired with different pairs of groups, 
Table 10* shows th^ differences between groups in each pair. The advantage 
to. black candidates of shifting from traditional to half black and half •; 
modefi\;^items in each instanc't^ approaches 20% of 'the- total pumber of items. 

^The advantage "*to black candidates that would result from a change from all 

V ^ 

moaernsto all black items would be about the same. Finally, achange from 



all traditional to all black items would boost the score of the average 



\ 



black candidate 'relative to that of the average white candidate by almost 



\ 



19 points, nearly 30%f ; 



Insert Table 10 about here 



The comparison of female black candidates from u^an Mississippi and 



^ ones from rural Virginia (Groups C .and F) indicated that the two groups 






differed much more on traditional' items thtm on black and modern ones* The 



rural Virginia worpen were -distinctly superior on traditional items and only 



slightly betDer oh* black-modern onbs, so that the urban Mississippi group 



would benefit by almos'^t 11 points if the comparison were made on black- 



modern items rather than on traditional ones . 



Replication of F/arm A 



The 



relevant findings .from the 197^ replication using* .Form A ar^ presented. 



V 



in Table 11 and summarized in the seven .analyses" of variance given in Table 12. 



A significant interaction between candidates iA the saipe racial group and th 



liifference be-twecn literature And art- items occursi in only 1 of the 7 racial 



/ 



comparisons (Table 12, line 8). Ex 

- \ 



;) 



Exd^t iri*-^^this case, no difference betiijeen the 
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candldates' knowledge of art or literature was found;, when 15 ITtems of each 

• ^ , 

• * \ < ^ ^ ‘ r 

type vfere used. .Similarly, a significant second-order interaction (candidate 
* * ' -o 

by traditional vs\ social studies by traditional vs I black and modern ^teiiis) 

\ . ^ 

occurs in only 1 of the. 7 racial comparisons... No attempt will'be made to ' 

. . • ’ ■ I - ' ' • » 

interpret this finding here. • •' . c 



N.' 



5« ^ 



Insert Tables 11 and 12 about here 
■ .'I. J 



f 



\‘ 



In 'contract, candidates interact significantly with social studio's vs. , 
« ’ *, - - 

literature and arc items (Table 12, line 9) in 6 pf the 7 racial comparisons 
implying that not all candidates would do equally well on both .a' s'ocial 

• • • “ c ^ ^ 

. studies and a literature and art. test, confirmng the fact that the two 
tests sample distinct fields *6f knowS^edge. ' • . , 

Differences^ be tween* a test made' up of traditional items* and one made 
up of equal numbers of black' and modern items (Table' 12, line If) were si'gnif- 



icant in 3 of the 7 racftt comparisons.- 



) ■ 



In contrast, significant interactions between candidates and black vs. v 
■ - ^ ^ ‘ T. 

modern items were found in 5 of the 7 racial ‘comparisons (Table 12, line 6). 

' . e , .. • \ ' 

Thid suggests that«S^en. candidates of the ‘same sex and race are compared, 

^ * \ * ^ 

the culture repre^nted l|y the items is an \ important ^factor in determining 
their relative" achieyement,' along with, subject-matter content* ‘ Group's .A and 
/ B, composed of urban -females in North Carolina, and Groups M'and N, composed 
or males in rural Mississippi and Maryland,* did not show this phenomenon 

n • . . f ' ■ 



X. 
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Interactions’ between groups and item types indicate group differences 

• e’ ,* ‘ 

in mean performance qn the^ different types of items and are ^har^efore more » ; 

closely relevant to this discussion. Group differences related to subject- 

matter content in second-order intlractions involving cultural origins were 

found in two instance^ (Tablfe 12, lines 4 arid. 5) and in two pairs of groups 

in which*, groups, interacted, with social strudies vs. the literatifre and art 

'items.^ As in ,the first study, littLe evidence was fowid to suggest that- ‘ 

'group differences were gr^^te.r in 'any one subject area than in another. * 

• i \ 

Differences betweeq black "and modern, items occurred in 6 .of the - 7 .^ racial 

comparisons, however, and the seventh comparison was very ^lose to' significance; 

* • • ’ . * \ * f ^ 

similar results were obtained, with respect Co black ^nd moderij items combined 

• ■ \ , • , , • . ■ *9 ^ , ■ 

,!vs. traditional items^. ' 

' ^ . , V ; 

Table 13 shows the differdnces between groupd" in each pair. The advantage 

, ' ■ _ • • ■■ ' 'i. 

to black candidates df shifting from traditional to half black^and half modern 



.A 



/ 



items in the 6 of the > raejial^compar-isons* that/show significant differences. 

■ ' c5^ . ■ • 

averaged H points on a test of a” projected . length of 65 items. The advantage-^ 

• . . '• • ' ' " v' 

to black candidates that would result from a change fj:om all modern to all black, 
items would> be almost 12 points." Finkllyj a change from all traditional to 

all black items would boost,,rtlie score of the average -black candidate relative 

* •• ' • ■ .1 ’ 
to that,' of the average white candi^te by art average of 16 points, nearly 25%. 

Except in the- two cases in which Mississippi blacks were compared with Maryland 

i • ’-r 

whites, the yresiilts^ are highly consistent with ^hose obtained in the first 
study. (cf. Table 10). 



\ 









-± — _ — 

Insert Table 13 about fflere 
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Form B 



\ 

# 



Vi 



** ' • • V « f ' 

^ -The releWnt findings from the 1971' administration of Fprm B are 

» • . , . ' * . . 
presented in 'Table 14 and summarized in Table' 15. Only 1 of the"4 racial 

^ ^ It*'-. 

comparison^ showed a significant interaction^ for each of the following: 
candidates by black \s. Inodern items Cfabie 15, line 5), candidates by ^ 

' ' , . . V . 

traditional items vs. eqtial/humb^rfi’ of ' black' afid modern i^ms combined 

. .(Table 15, lifte' 6^, and candidates by*iiterature vs. aft items (Table 15, 

/ . ^ 
line' 7). Since these results were not consistent; across groups, they, will 

not be discussed any further here. ' t ' - 

i /■ ‘ " * • ‘ ^ ^ ■ 



. J 



' ( T 






\ 



Insert Tables 1,4 end* 15 about here 



/V 



'Two 6T the four racial compai;isons 'showed a'significant second-order 

interaction fm: the candidates by traditional vs. black-modern by literature 

. / . • , <"/ , 

* . * * * . - ' ' • .* 

VS. fine-art items and fot^ cand'idates by tfardltional 'vs. black-modern by 

» • f. .. , ■ • . 

• ■ . » 

social studies vs. literature and !art items. # * ' . • • 

> • ' I ' r, * , * * r - » • 

.i Candidates interacted > significaptly with spcial' studies ys. ' literature 

• .* • “ ■ ' r ' • ■ ' 

and art items *(Table '15 ,. line 8) in *3>of th'^ 4 racial conjparisohs^ 'this suggests 

' . . . ■ • ^ . 

. that social studies item? d6 ^indeed sample /a ^iffeffent field of knowledge 

" t » ’ ' -N ’ . * ' 

■ - 'than that sampled, by lite^atur^and at^tem'S. ' y ' . 

Interactions between groups and item types, which .indicate group 
differences in mea'h performance on the diff^ent types of .items, j-elated 
to subject-matter C 9 ntent^ occurred in two analyses — one o^f which involved 
a second-order interaction. . * • . . , ‘ 
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Interactions between race and differences between black and modern 

items, and^ between race and differences, between black and modern items 
. . ^ ' ‘ ; • ' 

combined and traditional items were found in all four comparisons. Table 
16 shdws the differences between the groups in each pair. The advantage to 
black candidates ^f shifting from traditional to half black. and half modern 
items^was significant in all. four racial comparisons; , with an average 
advantage of ^Ijnost.iO points on a test of a projected length of 65 items. 



The advantage to black candidates that would result from a change from all 
modernito all black items would be almost 22 points.’ .(The ^median difference 
between black and modern items was largerj.for Foriti B than for Form A--22 
points ^vs. 12 points.) Finally, a change from all traditional to all black 
items would boost the score of th^ average black candidate relative to that 
of *the average white candidate by an-ayerage of 20 points, more than 30%. 
Once again, strikingly consistent results were obtained. 



Insert Table 16 about here* 



^ SUMMARY AND DIS,CUSSION 

■ '■ ' •• \ 
The results about the impact pn relative performances of black and white^ 

caiididates that relate to decisions about relative numbers 'of black, modern, 

and traditional Items inclijded in the NTE are quite consistent. During the 

past two years th^ content 'specifications of the ..social studies, literature 

' . * * • rf 

and fine arts subtest of the, NTE Conmib'n Examinations have been' changed to 
include a. larger proportion of items that we have classified- as black or 
modern, apd these changes in the < test specifications reflect both the ' 
influence of a' concern for the recognize^^ontribution of thesjt tfypes pf 
items and^jdie contributioif^^of research along' the lines described in this 
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Fortun^te^yl the contribution to total te^t score made by this, subtest 

• ■ I ; , 

f * 

is siria\l. The description of the content validity of the NTE. would involve ^ - 

. a 'study not only of* the cutricular offerings of teacher training ►programs 

but also of an analysis , of the types cxf knowledge needed by teachei^s ,in the 

cla^sr^oms. In this research study,- we accepted the content of the ’subtest 
** ' ■ 

, ■ . V 

that we studied as reasonable, ^ and concerned. pu4?s€Tlves with the influence of 
cultural femphases within these content areas. ✓ | 

While it is rtue the compaifisons made be^tween the races in the original 

•• • : • / ' ■ ' • ) ' ' * • ’ ' ' * ‘ 
study were in each instance confounded with differences in where the test was 

-taken, which may have allowed regional or ^urban-rural differences to distort 

’ ■ . ■ ■ ■ ■ i 

the racial comparisons, this is not true of the replication study done in 1971, 
and yet the results were virtually identical in the latter study. These 
.. results leave little doubt that bl^ck candidates tend to possess a different 
. set of knowledge than white .candidates, and thatT^ese* differences have 

little to 'do withr conventional subject-matter areas. Ther differences reflect 
differences in the particular subculture sampled .by. the items. Black 



candidates ^know relatively more^^lout black .culture than, they do about white 
culture. \ ^ . 

. . • * • ^ ^ y/ 

- The, consistency of ‘the findings -across the three studies is striking. 

In all; ,14 pairs <yf black vs. wliite candidates, were compared in various 
-locations. Significant interactions between groups and cultural origin of 
items we pe foiind inll3 of 'the 14 pairs. The median advantage to .black 

« I -v 

• I 

candidates over white candidates if a projected test consisting of 65 black 
items were used instead of ^projected test of 65 modern^items would be 12 ^ 
\ points. 
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When black and modern items combined were 'compared with traditional 



items, *"13 of*. the 14# comparisons produced, significant differences, a^d the 

» • ' • , • • 
median advantage to black, candidates was estimated co be 11 points if a test 

« * **)* ' 

of half black and half modern items were used instead of a projected test on 

^ r .ft ' 

which all 63 items we i;e traditional. 

», ' • 

• The contrast between the black and traditional items was not tested 
directly (becausd it was not orthogonaJL to the' other contrasts testdd); •’ 



however, the median advantage to black- candidates over white candidates if 



a projected test of 65 black items were used instead of a'f>rojected test of 

65 traditional ones was estimated to be Ig'points — almost 30% .j 

/ 

^ The most interesting question left unanswered in this study is, if 

within a group homogeneous as to sex^, race, and institution in which tested, 
some candidates do best on black items, some do best o n jrio dern ones, and 
some do best on' traditional ones, in what other ways ard these three types 
of candidates different? Does this ^"selective learning factor** reflect 



differences in interests- or concerns, of individual candidates which might 

I - ° 



, relate to their, effectiveness as teachers iq lirban schools vs. suburban 



I, 



scHbols, or in integrated schools vs: segregated ones? 
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FOOTNOTES 



1 . ■ ^ ' r , 

*This project was supported by the National* Teacher Examinations Program 

at Educational Testing Service. Several colleagues ait Educational Testing ‘ 

Service have provided valuable assistance during this project ;, in _particular , 

^ we would like to thank Richard Majetic for his patience ancT Encouragement, 

" V ^ ^ ^ • j. . . . . ■ ^ ' 

and Kitty Kornhauser and Staf( liuc Donald for writing the necessary computer ’ 

program for the analyses. \We^would especially like to acknowledge the 

contribution the Test" Development Staff at Educational Testing Service 

t 

1 . • 

who provided excellent cooperation with us both in terms of providing the/. 



-'j 



necessary types of items through the usual procedures an3 in meeting our 

^ X . 

demanding schedule requirements. 

2 

In Tabled 3, 4, 5 "population" refers to the size of the popuiatiop i n 

the city in which the NTE ^testing center was located, as given in Long (1968). 
3 ' . ' V * ‘ 

All means in Tables 10, 13, 16 are based on projected tests of 65 items' 
of the type indicted. . 
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Table 1 

Item Distribution for E>:periment8Ll^Su^tests 









. ITDE Coiniiion 
Examination 
Sub tests 

/ 




— i 

Item Type 


- 


/ 


. Black 


Traditional ' ‘ 


Modern 


Total 

J ■ - 


Fine Arts ‘ 

-.y .. : ■■ 

Literature 
Social Studies 


5 _ 
5 

10 


s 

5 • ■ 

• 5 • 

10 


A 

.5 

10 

•♦j 


/' " 
15 

> 

50 

- M 


• Total 


20 


20 


20 


r 

60 


• f 

* ■ , • 


\ 


'• 


^ < 


■ 

f 








‘ 
















• 






< 








f 


m ■ 






\ 


• 










\ 






\ 
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Table 3 






Composition of the Samples of College 'Seniors Used in the Original Study 



O 

ERIC 



^ Population^ 




Candi 


•dates 


Sample Selected^?- 




Male 


Female * 


Designation 


Type 




White- 


Black 


..White. 


Black 


^ . 150,000 


I^uislana » 


0' 


' 

11 


r 

0 ■ 

« ‘ V 


67 


A 


biaclK 

female\ 


lUOjOOO 

’ * 
, 1 


Missd^s,^^ppi 

m 


q 

r 


h9 

L 




8b 


B 

C 

. 1 
1 


/ 

black. 

male 

black 

female 

' 


,10,000.. 

h 


Mississippi 


. 44 


•0 


113 . 


• 2 


D 

_ ' f 


# 

white 

female 

white 
male ' 


u ^ • 

bo, 000 ' 


Virginia 


jt"-' 

• Q 


26 


1 


100 

i 


F- 


black 
female ^ 


; , • • 90,000 ‘ 


i 

West Virginia^ 

1 


— r 
23 ' 


\ 

0 


101 


1 


G 


white 

female 


Totals 

V, 

1 

t 


^ ^ * 
67 


86 

f ■ 


i " 
215 


25b 


4 

t » 

V 


153 • 


U69 ■ ^ 


622 ' 



^ ^ ' •" , ^ ' • . ' ■ ' ■ ■ ' ' 

■«-Each of the seven samples (A through^ GX contained bb candidates randomly selected. 

• .4 , 
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• . ' Table 4 , > ' . 

» . . ■ 

Composition of the Samples of College Seniors Used .in the Replication of Form A 



2 

Population 


\ 

state 


Candidates 


Sample Selected 1 




Male 


Female 


Designation 


i 

’Type 


1 

N* 


If/liite 


Black 


White l^lack 


7 , 800,000 


New York 


65 

9 


- 4 

1 

. 1 

1 

1 


264 ! 

> 


,55 ' o' 

I . 

1 . • • 


white 

female 

black 

female 


'4 ; 

54 . 1 

^ \ 

• \ 


' 5 , 600,000 


Illinois 

f 


11 


. 0 ! 60 ' 


■ 5 i 

• ^ 




. ' 


150,000 


■ North 
Carolina 1 

i 


0 


14. 


• 1 


56 J A 


black 

female 


'44 ' 


.150,000 


North 1 48 ' 

Carolina 1 

* i 


0 


24 1 

i 


! \ 

\ ■ . ' 


j .^vrhite ; 

1 • female 1 

1 / 1 


44 . 


Less than 
J^^OO 


] 

‘ Mississippi | 

> • 1 
j 

- » 1 
i 


1 0 

1 

I 

j 

i * * 

1 

! 


42 

*1 


• 0 

. 

•I 


1 . ! 1 '' 1 

! 79 ^ C 1 black j 44 . 

1 ‘ j 1 f pniale | 

' : - I i black : 54 (selected 

! , I female ' randomly 

1 . : 1 i - ■ ; from C ) 

' ■ ' \ • J ; black J 54 ^ , 

1 ; ' . male ’ ^ 

i - 1 • 


Less than 

2500 


J 

Mississippi 


1 0 
1 


^ i r ■ 

20 1 ‘ 0 

1 

i 

. ! - 


1 64 ■! 

1 ! 

1 


^ i ^ 1 , , ^ i 

i L 1 black 1 44 > 

. • ! female! 

N . 1 black [20 ' ' 

male 1 ■ 

A ■ 9 ■ 

^ !! i 1 • • 


■ 7,000 


Maryland 


92 


0 

j 

i 


145 


- 0 ' 

1 • » 

1 1 

j 

1 

1 

» 1 

1 

I 


D ’ white 

1 female 

1 * K white 

1 

male ' 
M'' white 

male 

;) 

; ■ r 

1 


1 ' 

1 '■ :• 

54 ■ 

20 (selected 
randomly 
j from K) 


2,000,000 

V 


Pennsylvania 

j 

i 


49 ' ‘4 • 

e 


! 128 

i 

1 


j 54- i 
1 ' 

! 1 


f 

R white 

j ' female 

I' black 

\ 


■54 ;• 

54 '; r 



*Saraple size' selected randomly from the total subgroups. 
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' Table 5 

Composition of the Samples of College Seniors Used in Form B 



• V 

i 

Population^ 


— 1 * ^ ^ 

. Candidates •, Sample Selected 


' Mhle 1 Female 


'■ i 

1 

Designation 1 .Type N* 


State ;White 


Black 


White j Black 


. 7,800,000 


New .York ! 52 




^188 1 6 




5,600,000 


Illinois 4o 


- 4 


92 ! 21 

i 


F 1 white 21 

. 1 

1 female 

G i black 21 

! female 

1 


900,000 


Texas . 5 


9“. 

r 

1 


5 ! 50 

k 

1 ; 

1 * ^ 


B j black, 44 

! female ’ 


- *^0,000 


, ' 1 ' ' 1 * ^ 

Texas 6 j 1 ; 64 3 i A ; white -44 

. ^ ’ 1 * ' • female 

• . } 'X 1 ! • i 


» 

Less than 

2506 • 


Alabama 0 


j j 

18 j ' 0 ' 104 ; C i black ‘ 44 

I i ! female' 


Less than 

2500 


Alabama 17 ^ 0 | 115 1 D 


white 44 
female' 


90,000 


Massachusetts’ 4 i , 0 . I8 0 - • 

1 * ' 




,900,000 


Texas 28 1 '• 15 ^ 4 E. 

• 0 • ’ i - . 

" • • • • 


white 44 

femalej 



*Sample size selected randomly from the total subgroups. 



^ H 



30 



liil 












/ 



. 1 



i • 

i •• 

n 

i 














- 

I 






<• 











r 




■ > 







J 



■1 ■ . 









o 



r ■ 

f 

i 










/ 






- 33 - 



Vi 



• 0 ) 

iH 

cd 

H 



; 



•I 

CO 

a 

•H 

•H * 
U 
O 

(U 

+5 

•H 

rA 



0) 

+5 

H 

.o 

CO 

(U 

p< 



o 

■e 

nd 

0) 

+5 

cd « 
H 
(U 

W 

CO 

(U 

o 

c 

(U 

(U 

•H 

O 

o 

+5 

cd 

a 

•H 

G" 

bO 

•H 

CO 



1 



■ 1 
• j 
i 



1 . 
.' i , 

o 

[ERIC 



+>' 

A 

bO 

H 

« 

ra 

(U 

cQ 



§• 

O 

S 

C 

(U 

-p * 
(U 

pq 

CO 

(U 

o 

C 

(U 

Ph 

0) 

•H 

n 



(U 



Ph 



td 
H »H 
Q* CS 
CO Oi^ri 

■ H bO 

“1 CO . Ph 
CO 

B -H > 
• <u CO 
CO Ph CO H 

o o . 

.r§ 

PQ ^ 



pc; 



CO • 

<U CO 

d > 
i9 . ^ 

pq • a *H 
•H cd jC 
s CMH g 
w> CMpq , 
p 'H ■ H 
CO C,cd 
pq CO .g 
•H ^ P 
CO ^ pc; 

CO fc> 



CO 

(U • 

I— I CO 

. SS l> <u 
S , -P 
Q) X -H 
• o ^ 
.• cd s 
CO 'H iH 
^ pq H 
CM * cd 

t § h 

CO ^ pc; 

CO jb 
CO 



l> 

O 



+3 
CO ' 

o 

p 

o 

•H 

S' 

CO 

o, 



■o 



i *t» 



CO 

c 



ON 0\ 



C^ 

+ 



rA 

- I 



* 

CO 

• 

iH 

H 

+ 



ON CVI 



bN 

+ 



.4- 

I 



* 



+ 



• 0) 
CO +5 

> d 

X § 

•• o 

O CO cd cd 


% 


' * 


^ (U ^ •H 




* 


• H <t5 G 


VO CVJ 


CO 


CO d *H 


• • 


• 


|> B cd bO 
0) q Ph 


VO m 

+ * 


-S 


<U liH a .H 
•HT> 
* CO 

■3:5 


/ 


+ 



0) 

+3 

H 

X 

O 

cd 

H 

pq 



<u 

+3 

H 

d 

Ph 

'S 



s 

I 

pq 



<u 

o 

<u 

Ph 

<U 

•H 

P 



UN m 

V® ‘NO 



CVI 

I 



CVJ 

a 

I 



* ; 

* 

CO 

*^+ 



/ * 

CT\ ^-j t^' 

H i 



. ON 

OJ 

+ 



‘I 

ON CO 



CT\ 

I 



CVJ 

I— i 

+ 



CO 

o 

+ 



c— 

CVJ 

H 

I 



i 

-ITN 

t<\ 
. rH 
+ 



C 

Ph 

0) 

nd 

I- 



cd 



X 

o 

cd 

S 

cd 

X 



0) 

+3 

H 

m 

VO 



<u 

+3 

H 

o. 

•H 

s 

IfN 

VO 



I 

^ — \ 



<u 

o 

c: 

0) 

Ph 

<U 

V ^ 

\.nl 

. n 



35 






CO 

9 

+ 



tT\ 

S' 

• + 



nd 

0) 

+3 

CO 

0) 

/•P 

+3 



I 

pq 



<u 

o 

<u 

•SJ 



U . : 






y 



6 • 



ITN 

O ^ 

V. 

V, 

d ^5 

V .*• • 

H V A 
o 

* * • 

CO 



j “ 

^ ' ■■. . 

j ■ 
i 

i . . 

A 

*v 

-r ■• 

■ . 



f'fl ■ 



I 



•i 



1 



I 







Ttlil* 11 



l^llftfti Anilyylt of Scoron of Coo^ftoCtt In Cho K*pHcatloB of fom A 



f 



Sourct of VtrltcloB 



ftoevt'cn Croupo 
CoRdldaCM (Uichlo Croupt) 
Block VO. Kodom icoM 



TroiUloiul VO. Block ood 
Hodora 1cm 



Croupii 



Sua of 
Bcuorot 






iB.ia 

B3.1S 



Hooii 

Squorc 



IZ.IB* 

O.I7« 



<9, SO'* 

*S.12 



Be. Lltoroturt .*o. Arc fcoao 
V 

3d. 

•If. 



Soclol ScuiUi vs. Arc and 
Licsrscurs Ictoo 
TroilclORol X Llcsrocuro 
Ictu . • * "A 



IB. 

3b. 



Block X Soclol SCbdlSO lc«u 



Trodlcloool X Soclol Scudloi 
Iceso 



Icoao Uicblo foroo 



3o 

Sb. 



Croups X Block VO. Hedois 
I ctso 



, Croups X Trodlclonol vo. 
Block ^oil (fodom ICMo 



Sd. 

3o. 



Croups, X Soclol Scudloo vs 
Arc sod Llcsrocuro Icoao 
Croups X* Block X Llcsrocuro 
Icoao 



Sh. Croups' X Troiltlonol X 



Croups X Icoao Vlchla Fotao 



Condldocos X BlscV vf.' 
Kadtrn Ictss * , 



Conildartt X Tr4dlc^:.jJ; 
VO. 3Uck sad Kodtrn Icosa 



Condldocos X Llcsrocuro vo, 
Arc iCcao 



Coodldocos X Soclol Scudlos 
vs. Arc sad Llc«ro(urc‘Icsaa 



B.33 

3.92. 

/B.7S 



B.3> 

3.92(a. 

B.7SS 



s.> 






' 87 
2.03 



l.SSs 

3.03‘ 



9.12 

4.72 



I . 



7h 

>. . Bcolduol VorlocloQ 



. Condldocsi X Trodlclonol 
X Soclol Scudlirs Ictao 



^9. Tocol VorloClon 



Sua of 
_Sqmrss- 



.0.37 

32.24 

33.9S 

1.34 



Neon 

_S3uore 



0.37(a.s.) <1.0 
0.79* 4.31 

*33.98* 9.21 

1.34(b.s;)<1.0 



O.OOKa.s.Xl.O 



38 

1 



117.39 

''3.t4 



.3.33* 

I 

5. 84* 



19.14 
" 8.99 



2. >3* 



38 

88 



17.39 

23.79 



0.31* 

0.38* 



1.77 

2.07 



88 • 



1.7^ 



3,%8 847.33 



4,079 1.019.82 



t vo. r 



Sin of Mr on 
df <quoteo 



1 oT^ o.9>(a.s.> <1.0 
88, 73.31 l.lf* 8.38 

L^4.83 24.83* v 6.23 

1 3.31 . 3.31(n.o.) 1.88 



22.88 

0.00 



22 . 88 * 



8.09 



O.OOfn.o.) <1.0 



33 133.82 
1 3.83. 



2.80* 

3.83* 



18.09 
, 9.39 



38 21.37 

88 13.64 



0.38* 

0.24* 



niB 

1.37 



88 18.73 0.23* 

f 



3.898 642.98 0.174 

^ — 



4.C79 1003.99 



Sua of 

df Squoreo 



"T 
88 
■ 1 



Neon 

Squofo 



13.27 

30.77 

14.00 



17. 17* 
’ 0.i9* 



14.30 

3.41 



8.33(n.o.) 2.71 



tr 



37 

1 



181.47 

3.32 



2.83* 

3.'32* 



18.38 

3.97 



37 

88 



y 

38.02 ' 
21.89 



0.83* 

O.2U 



3.84 

1.43 



< 

88 



4,902 848.23 0.173 



S»279 1197.39 



I 

68 
' 1 



1 






O * 

ERIC 



36 












i 




• <. 



\ . 



\ 






t 



y 






C ¥•. 0 


* A VO. 8 


J wo. K 


d( 


Sito of 
Sciiarct 


M«4a 

Scwaro 


r 


df 


SuQ of 
Scitoreo 


Hc«n 

Seuaro 


r 


if 


Sua of 
Souaroa 


yjar. 

S^u«r« 


y 1 


1 


12«40 


12.W*‘ 


— rw 


1 


14.41 


14.41* 


i.ii 


1 


Vm 


l/.oo* 


\ 


8* 


^ 51.42 


0.68* 


1.69 


66 


72.11 


0.84* 


4.94 


66 


44.04 


0.97* 


5.74 * 


1 


2^41 


:2.4i* 


8.71 


1 


11.88 


11.88* 


11.47 


1 


12.18 

1.77(n.o.) 


12.18* 
1.77 (a. 


*•>0 




k 












"’7 


* 


a^X^O 


1 


10.95 


10.95* 


4.68 


1 


6.01 


6.01 (n. 


0.) 2.04 


- 


— 


— 


. — — 


1 


1.44 


1.44(a.«, 

tP 


.Xl.o 

^ — 


1 . 


0.17 


0.17(o. 


t.Xl.O 
























' 1 


9kU 


9. 11 (o.o, 


.) 1.98 




t 


% 


- 


* 


11.27 




e — ~* 

5.55 


















11.27* c 


, , 


.»• 


. 





1 


0.11 

152.71 


O.U(a. 
. 2.78* 


o.Xl.O 

14.15 








/ 


5» 


* 128.97 


2.14* 


11.17 


55 


56 


111.^5 


7.38* 


f 

14.08 ^ 


1 


7.92 


7.92* 


O.IO 


1 


15.42 


15.42* 


21.42 


1 


% 2iV^ 


2.72(o. 

1 


..)? i.if 


1 


9.04 


X 9.04* 


14.15 


1 


16.00 


16.00* 


22.22 


1 


l'97 


1.97*^ 


• J.67 


-1 


6.21 


f 

6.21* 


4.95 

1 






* 






- ■ 








- 






,■ 




. 


2.11* 


4.6* 
























J 


. 
















*- 








54 

14 


\5.17 

21.12 


0.61' 

0.25* 


1.40 

1.'41 


57 


41.04 


0.7?* 


>.24 


56 

66 


16.10 r 


0.50* 

0.25* 


7.96 

1.46 ^ 
























. i.n7 


















66 


1S«27 


. 


/ 


• 






86 

16 


21.52 

24.51 


0,25^ 

0.29* 


1.71 










•6 


24.74 

i 


• b 

d.29* 


1.6> 












A 






16 
4. 114 


t 

21.14 
419.93 • 


0.25* 

0.17 


1.41 










4.90: 


440.72 ’ 


o.m 




”5 ■ 

1.7b2 636.9! 


0. 169 














't ■ • * 


■ / 












s;279 


1209.74 






5.279 


>fi7.00 






4.079 968.4) 

* 




4 






37 



♦ \ 






Source of VarUclon 1 . . 



V 






\ 

\ 

\ 



- 37 - 






O 

ERIC 




\ 



A 



Svmimary of Findings with Respect to Group and Candidate Differences' on Form B 
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(10) Candidates by (T X S Items) 

* P < .05 (signific'ant, .05 level) 
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